High Quality Novel View Synthesis Based on Low Resolution Depth Image and High Resolution Color Image

In this paper, a new technique to generate high resolution depth image is proposed. First, a low resolution depth map is obtained by the time-of-flight depth camera. Then a high resolution depth map for a given view is generated by depth warping followed by depth value refinement taking into account the color information at the given view. The edge in the final depth map is then processed by bilateral filtering for edge preserving. With the color image and the corresponding depth image, novel view synthesis can be carried out by depth image based rendering (DIBR). Experimental results show that the depth map generated by the proposed technique is able to ensure novel view images with high quality.